APR. -04' 05 (MON) 13: 10 HESLIN ROTHENBERG TEL:518 452 5579 P. 005 



Amendments to the Claims 

Please amend claims 1 , 3, 5, 12, 14, 1 6. 23. 25. 27 & 29 and add new claims 36-30 as set 
lurid below, and cancel claims 2, 10, I 1 . 13, 21. 22. 26, 34 & 35 without prejudice. In 
accordance with current amendment practice, all pending claims are reproduced below. The 
changes in the amended claims are shown by underlining (for added matter) and 
strikethrough/double brackets (for deleted mailer). 

1 . (Currently Amended) A method of evaluating a software component, comprising: 

de riving a conce ptual la> ering sche me of the software component the 
conceptual l ayering schem e dividin g die so 11 ware compone nt into multip le 
soft-ware layers, the multi ple software la yers taking into account relationships that 
exist between software layers; 

providing an abstraction matrix in m athematical abstract form that 
describes the multiple software layers of the software component and accounts 
for the relationships that exist between the software layers , the abstraction matrix 
further comprising at least one test case scenario for each software layer and 
mapped expected results the refore Therefor ; 

testing the multiple softw are [avers of the software component using the 
test eases case scenarios to generate test results; and 

evaluating the test results using the abstraction matrix, the evaluating 
including for each software layer automatically comparing a test case employed in 
the testing of the software layer to the at least one test case scenario of the 
abstraction matrix therefor, and if a match is found, automatically comparing the 
test result for that test case with I he mapped expected result th erefore for that test 
case scenario in the abstraction matrix ; and 

wherein evaluat ion of the software com poncnt is accomplished upon 
co mpletion of evaluation of the test results . 

2. (Canceled). 
POU920000I83US1 -2- 
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3. (Currently Amended) The method of claim 1 , further comprising, prior lo said 
testing, deriving at least some test cases for each software layer from the at least one lest case 
scenario of the abstraction matrix. 

4. (Original) The method of claim I, wherein the software component comprises 
multiple states, and wherein the abstraction malrix comprises multiple test case scenarios, each 
test case scenario being associated with a different slate of the software component. 

5. (Currently Amended) The method of claim 1 , further comprising generating an 
error log, said error log containing a list of test cases each having a test result which tailed to 
match the mapped expected result therefore therefor in a matching test case scenario of the 
abstraction matrix. 

6. (Original) The method of claim 5, wherein said error log further includes the test 
results of the failing test cases, as well as the mapped expected results from the abstraction 
matrix for the failing test cases. 

7. (Original) The method ol claim 1, further comprising creating at least one test 
results tile and at least one abstraction matrix file, and wherein said evaluating comprises 
automatically reviewing each test result in the at least one test results file by comparing its lest 
case to the at least one test case scenario of the abstraction malrix contained in the at least one 
abstraction matrix file. 

8. (Original) The method of claim L wherein the providing comprises creating the 
abstraction matrix from a functional specification of the software component. 

9. (Original) The method of claim L wherein the evaluating comprises 
automatically extracting test statistics, said lest statistics including a total number of test cases 
executed, and at least one of a total number of lest cases successfully executed or a total number 
of test cases unsuccessfully executed. 

10. Canceled. 

11. Canceled. 
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12. (Currently Amended) A system for evaluating a software component comprising: 

mean s for deriving a con ce ptual layering scheme of the software 
component, the conc e p lual layer in u scheme dividing the sollwarc com ponent ink > 
multiple software laye rs, the mul I iji le software layers taking into account 
relationships thai exist between software layers; 

an abstraction matrix in mathematical abstract form that describes the 
multiple software layers of the software component and accounts for the 
relationships that exist between software layers , the abstraction matrix further 
comprising at least one test case scenario for each software layer and mapped 
expected results # icroforo therefor : 

means for testing the mul tiple software layers of the software component 
using the test Gases case scenarios to generate test results; m& 

means for evaluating the lest results using the abstraction matrix, the 
means for evaluating including for ea ch s oftwar e lay er means for automatically 
comparing a test case employed in the testing of the software layer to the at least 
one test case scenario of the abstraction matrix therefor, and if a match is found, 
for automatically comparing the test result for that lest case with the mapped 
expected result therefore for that test case scenario in the abstraction matrix ; and 

wherein evaluation oft he so ftwar e co mponent is accomplished up on 
completion of the evaluation of the test results . 

13. (Canceled). 

14. (Currently Amended) T he system of claim 12, further comprising means for 
deriving at least some test cases tor each software layer from the at least one test case scenario of 
the abstraction matrix for use by the means for testing. 
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1 5. (Original) The system of claim 1 2, wherein the software component comprises 
multiple states, and wherein the abstraction matrix comprises multiple test case scenarios, each 
lest case scenario being associated with a different stale of the software component. 

16. (Currently Amended) The system of claim 12, further comprising means for 
generating an error log, said error log containing a list of test cases each having a lest result 
which failed to match the mapped expected result therefore therefor in a matching test case 
scenario of the abstraction matrix. 

17. (Original) The system of claim 16, wherein said error log further includes test 
results of I he failing test cases, as well as mapped expected results from the abstraction matrix 
for the lading test cases. 

18. (Original) The system of claim 12, further comprising means for creating at least 
one test results (lie and at least one abstraction matrix file, and wherein said means for evaluating 
comprises means for automatically reviewing each test result in the at least one test results (lie by 
comparing its test case to the at least one Test case scenario of the abstraction matrix contained in 
the at least one abstraction matrix file. 

1 9. (Original) The system of claim 1 2, wherein the means for providing comprises 
means for creating the abstraction matrix from a functional specification of the software 
component. 

20. (Original) The system of claim I2 T wherein the means for evaluating comprises 
means for automatically extracting lest statistics, said test statistics including a total number of 
lest cases executed, and at least one of a total number of test cases successfully executed or a 
total number of test cases unsuccessfully executed. 

2 1 . Canceled. 

22. Canceled. 
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23. (Currently Amended) A system for evaluating a software component comprising: 

m eans for d eriving a .conceptual layering s cheme of the software 
componegli^ schem e dividhm (he soft ware component into 

multi ple software la yers, the m ultiple software layers tak ing i nto account 
relationships that exist between software layers; 

an abstraction matrix in mathematical abstract form that describes the 
mullinle software lay ers of the software component and accounts for the 
relationships that exist between the software layers , (he abstraction matrix further 
comprising at least one test case scenario for each software layer and mapped 
expected results therefor e therefor : 

a first computing unit adapted to lest the multiple software layers of the 
software component using the test eases ease scenarios to generate test results; 

and 
uriu 

a second computing unit adapted to evaluate the test results using the 
abstraction matrix, the evaluating including for each software layer automatically 
comparing a test case employed i n the testing of the software layer to the at least 
one test case scenario of the abstraction matrix therefor, and if a match is found, 
autom atically comparing the tesi result for that test case with the mapped 
expected resull therefore for that rest case scenario in the abstraction matrix : and 

whe rein evaluat ion of t he software compo nent is accomplished upon 
completion of the evaluation of the test results . 

24. (Original) The system of claim 23, wherein the first computing unit and the 
second computing unit comprise a single computing unit. 

25. (Currently Amended) At least one program storage device readable by a 
machine, tangibly embodying at least one program of instructions executable by the machine to 
perform a method of evaluating a software component, comprising: 
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d eriving a concc ptuu I layerin g scheme of the software component , the 
conceptual layering sch eme dividin g the software compone nt into multiple 
software layers, the mu ltipl e software hi vers tak inci into accou nt relationships that 
exist between software layers; 

providing an abstraction matrix i n mathematical abstract form that 
describes ihe multiple software laye rs of the software component and accounts for 
the relationships that exist between ihe software layers , the abstraction matrix 
further comprising at least one lest case scenario for each software layer and 
mapped expected results tbefeJwe therefor ; 

testing the multiple software la yers of t he software component using the 
test eases case scenarios to generate test results; an4 

evaluating the lest results using the abstraction matrix, the evaluating 
including for each soft war e layer automatically comparing a test case employed in 
the testing of the software layer in the at least one test case scenario of the 
abstraction matrix therefor, and if a match is found, automatically comparing the 
test result for that test case with ihe mapped expected result themfefe for that test 
case scenario in the abstraction matrix ; and 

wher ein evaluat ion of the soft ware component is accomplished upon 
completion of the evaluation of the test results . 

26. (Canceled). 

27. (Currently Amended) The at least one program storage device of claim 25, 
further comprising, prior to said testing, deriving at least some test cases for each layer from the 
at least one test case scenario of the abstraction matrix. 

28. (Original) The at least one program storage device of claim 25, wherein the 
software component comprises multiple states, and wherein the abstraction matrix comprises 
multiple test case scenarios, each test case scenario being associated with a different state of the 
software component. 
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29. (Currently Amended) The at leasl one program storage device of claim 25, 
further comprising generating an error log. said error log containing a list of test cases each 
having a lesl resull which failed to match the mapped expected result therefore therefor in a 
matching test case scenario of the abstraction matrix. 

30. (Original) The at least one program storage device of claim 29, wherein said 
error log further includes lest results of the failing test cases, as well as mapped expected results 
from the abstraction matrix for the failing test cases. 

^1 . (Original) The at least one program storage device of claim 25, further 
comprising creating at least one test results file and at least one abstraction matrix file, and 
wherein said evaluating comprises automatically reviewing each test result in the at least one test 
results tile by comparing its Lest case lo the at least one test case scenario of the abstraction 
matrix contained in the at least one abstraction matrix file. 

32. (Original) The at least one program storage device of claim 25, wherein the 
providing comprises creating the abstraction matrix from a functional specification of the 
software component. 

33. (Original) The at leasl one program storage device of claim 25, wherein the 
evaluating comprises automatically exlracling lest statistics, said test statistics including a total 
number of test cases executed, and at least one of a total number of test cases successfully 
executed or a total number of test cases unsuccessfully executed, 

34. (Canceled). 

35. (Canceled). 
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36. (New) Thcmethod of claim L wherein the providing further includes parsing <he 
abstraction malrix to automatically generate and factor out doable test cas es and mapped 
expected results t her efor, and se parating the lest cases based on the software layers of (he 
software com ponent, and associating dat a str uctures with (he separated test cases of the software 
Layers, the data st ructures allowing the test eases of the various software layers to be 
uncorrelated. and wherei n the abstraction m alrix comp rises an abstraction file for each software 
layer, and the parsing comprise s genera] hu» a ma p ped expected result for each line of each 
abstraction tile based on associated state informaiion. 

37. (New) The method of claim 3 6 . wherei n the separating comprises eliminating 
dependencies between at least one in put of a software layer based on other inputs of other 
software layers of the software com pon ent, thereby uncorrclatinti test cases of the various 
software layers. 

38. (New) The melhod of claim 37. wherein the data st ructures for at least som e 
software lay ers mimic infor mation passed b e tween layers during normal operation of the 
software component. 

30. (New) Hie me thod of claim 38, wherein the software component comprises a 
cluster operating system component. 

* 4 * * * 
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